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Landauer's principle states that the erasure of information generates a corresponding amount 
of entropy in the environment. We show that Landauer's principle provides an intuitive basis for 
Holevo bound on the classical capacity of a quantum channel. 
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I. INTRODUCTION 

Landauer's principle H states that the erasure of clas- 
sical information leads to an increase in the entropy of 
the environment by at least the same amount. The im- 
portance of this principle is the insight that it is not the 
act of obtaining information that necessarily generates 
heat and therefore entropy, but the erasure of informa- 
tion. This profound insight has led to the resolution of 
the problem of Maxwell's demon by Bennett B . Here the 
missing entropy is generated when the demon's memory 
is erased. Clearly Landauer's principle provides a bridge 
that links classical information theory to thermodynam- 
ics. Recently, however, it has been shown that one can 
also use Landauer's principle to connect the entropy of 
erasure and the efficiency of entanglement purification 

i- 

Here we demonstrate that there is also a connection be- 
tween Landauer's principle and the Holevo bound which 
limits the classical capacity of a quantum channel. In 
classical communication via quantum states, we encode 
classical signals in possibly mixed, non-orthogonal quan- 
tum states and send those to a receiver. The receiver 
then has the task to deduce from those quantum states 
the original classical message. The maximal informa- 
tion that the receiver can obtain is limited by the Holevo 
bound y. It has also been shown that this bound can 
be achieved asymptotically (s). 

The purpose of this paper is to understand the Holevo 
bound in terms of Landauer's principle. This approach is 
more intuitive than the unavoidably very technical, rig- 
orous mathematical proofs. The hope is that this new 
approach may stimulate ideas that may lead to a better 
understanding of the more intricate problem of the quan- 
tum capacity of a quantum channel, a problem which is 
not yet fully understood (see however Q). 

This paper is organized as follows. In the next section 
we will present a general method for the erasure of in- 
formation which was introduced by Lubkin M and later 
generalized by Vedral |H] to non-commuting variables. In 
section III we will first briefly introduce the Holevo bound 
and then proceed to show how the Holevo bound can be 
obtained from Landauer's principle. 



II. HOW TO ERASURE INFORMATION? 

Landauer's principle states that the erasure of a 
given amount of information generates at least the same 
amount of entropy. In the following we will present a 
physical scheme for the erasure of information (due to 
Lubkin M) in its form for non-commuting states as de- 
scribed in H. This scheme has the nice feature that it 
can easily be made optimal in the sense that the entropy 
of erasure can be made equal to the amount of informa- 
tion that has been erased. 

Let us consider a measurement apparatus M. that is 
initially in a pure state (e.g. the ground state of M.) and 
then interacts with a system. This interaction results in a 
measurement, i.e. after the interaction the apparatus will 
be in one of a set of pure states {|?Tii)} with probabilities 
{pi\. The amount of classical information the appara- 
tus M has acquired during the measurement is given by 
the mutual information between system and apparatus 
which turns out be equal to the von Neumann entropy 
S{p) where p = '^iPi\'mi){mi\ is the average state of 
the apparatus p . If we want to reuse the apparatus M 
for another measurement, then this information has to be 
erased, i.e. we have to return M to its original pure state. 
This can be done with arbitrary precision by placing M. 
into contact with a heat bath of temperature T such that 
in thermal equilibrium the apparatus M will be essen- 
tially in its ground state (This can always be achieved 
by using an apparatus Ai with a sufficiently large level 
spacing). Note, that we do not discard the apparatus 
and replace it by some other system. In particular we do 
not dump it into the heat bath, as the number of parti- 
cles in the heat bath has to be preserved. Only energy is 
exchanged between the apparatus and the heat bath. 

For an arbitrary state uj we can always chose the tem- 
perature T of the heat bath such that in thermal equi- 
librium the state of the apparatus is described by the 
Boltzmann distribution 

c. = Z-ie-^^ , (1) 

where (3 = 1/kT, H is the Hamilton operator of the appa- 
ratus and Z = tre~^^ . To erase the apparatus we place 



it into contact with the heat bath. The total change of 
entropy of erasure is given by the sum of the changes of 
entropy both in the measurement apparatus as well as 
the heat bath. After the measurement, and prior to the 
erasure, the apparatus is in one of the pure states \mi). 
Therefore it will always increase its entropy by evolving 
into the state to given in Eq. (1). This change of entropy 
of the apparatus is given by 
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(2) 



Now we need to evaluate the change of entropy of the 
heat bath ASb- The easiest way to do so is by determin- 
ing the heat change of the bath. This is just the negative 
of the change of heat in the measurement apparatus A^, 
for which we find 



kTASs ^tr{H{p-uj)} 

= -kTtr{{p-uj)logZuj} 
= -kTtr{{p -Lo) log Lu} . 



(3) 



Therefore, the total change of entropy AStot of measure- 
ment apparatus and heat bath together is given by 



AStot = ASm + ASb 

= S{lj) — tr{{p — oj) logcj} 
— —tr{ploguj} . 



(4) 



We can see that the amount of erased information S{p) 
is never larger than the entropy of erasure, i.e. 



S{p) < AStot ^ -tr{p\oguj} 



(5) 



because the relative entropy S{p\\uj) — tr{plogp — 
plogu} is always positive. If the temperature of the heat 
bath is chosen such that for the thermal equilibrium state 
of the apparatus in Eq. (1) we have uj — p, then the en- 
tropy of erasure is exactly equal to the information that 
has been erased from the apparatus and the erasure is 
optimal. 



III. THE HOLEVO BOUND 

A. Classical Information via a quantum channel 

The transmission of classical information via a quan- 
tum channel proceeds in the following way. Initially the 
sender, Alice, holds a long classical message. She en- 
codes letter i (which appears with probability pi) of this 
message into a possibly mixed quantum state pi. These 
quantum states are handed over to the receiver. Bob, who 
then has the task to infer Alice's classical message from 
these quantum states. The upper bound for the capac- 
ity for such a transmission, i.e. the information / that 



Bob can obtain about Alice's message per sent quantum 
state, is given by the Holevo bound [Q 



/</h = 5(p)-^P.5(pO 



(6) 



In fact, equality can be achieved for large message- 
blocksizes as has been proven by Holevo M . The aim of 
the next section is to show how one can justify Holevo's 
bound from the assumption of the validity of Landauer's 
principle. 



B. Holevo's bound from Landauer's principle 



The idea behind the derivation of the Holevo bound 
from Landauer's principle is to determine an upper 
bound on the entropy that is generated when Bob erases 
the information that the message system carries in its 
state Pi. In this way we directly obtain an upper bound 
on the information received by Bob. To this end we con- 
sider different ways for erasing the information that Alice 
has originally encoded. The two methods of erasure are 
schematically presented in Fig. 1. Step 2 of procedure 
(2) corresponds to the erasure of Bob's information. In 
the following the accompanying entropy of erasure will 
be computed as the difference of the entropies of erasure 
in procedure (1) and the first step of procedure (2). 




(1) direct erasure 
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(2) Erasure in two steps 

FIG. 1. A letter of a classical message is encoded with 
probability rj, into a pure quantum state \4>a)- The infor- 
mation about the original message contained in this encoding 
can be deleted in two ways. (1) directly by placing the sys- 
tems into contact with a heat bath in state p, or (2) by first 
using heats baths in state pi and then a heat bath in state p. 

Let us begin by assuming that Alice initially encodes 
her message in the following way. Given she wants to 
send letter i, she then encodes it into one of the pure 
states {|0^)|a = 1, . . . , N} with probability r^ such that 
Pi = X)q ^a\'l'a){'l'a\- ^^ ^^c has cucodcd her message in 
pure states, the mutual information between message and 
quantum states is S{p) = S{^^piPi). This is the infor- 
mation that the encoded quantum states contain about 
the original classical message. Now we will erase this 
information in two different but equivalent ways. 



1. Direct erasure 

A message letter i which appears with probabihty p^, 
is encoded by Ahce with probabihty r^ in state | </<„}. We 
wih now delete the information encoded in these pure 
state by bringing them into contact with a heat bath. 
We chose the temperature of this heat bath such that 
the thermal equilibrium state of the message system is p. 
This ensures that the erasure is optimal, in the sense that 
it produces the smallest possible amount of heat. This 
procedure is illustrated as part (1) in Fig. 1. Following 
the analysis of Lubkin's erasure in section |l^, the entropy 
of erasure is given by 



A5(2) = -^p,tr{paogp} = 5(p) 



(7) 



Note that all information has been deleted because now 
every quantum system is in the same state p so that there 
is no correlation between the original letter i and the en- 
coded quantum state left after the erasure! 



2. Two step erasure 

First step: We begin by performing a partial erasure 
on the encoded quantum systems (see step 1 of procedure 
(2) in Fig 1). For a fixed i which appears with probability 
Pi, we place the encoded pure states into contact with a 
heat bath. The temperature T of the heat bath is chosen 
such that the thermal equilibrium state of the message 
system is pi . Again this choice ensures that the erasure is 
optimal. According to our analysis of the Lubkin erasure 
in section II, the entropy of erasure is then found to be 

A5W = -5]p.^trK|C)(C|logpJ 

i CK 

= -^P^tr{p^\ogPi} 

i 

= J2p.Sip.) . (8) 



After this first step in the erasure procedure there is still 
some information left in the physical systems. The letter 
i of the classical message is correlated with the state pi 
of the quantum system. In fact, this is exactly the situ- 
ation in which Bob is after he received a message which 
is encoded as in described in subsection III A . To obtain 



a bound on the information that Bob is now holding, we 
need to find a bound on the entropy of erasure of his 
quantum systems. 

Second step: In order to carry out step 2 of procedure 
(2) we place each of Bob's systems, which is in one of 
the states pi with probability pi, into contact with a heat 
bath such that the thermal equilibrium state of the mes- 
sage system is p. As the average state of the systems is 



p = J2iPiPij ^^ expect the erasure to be optimal again. 
We can see easily (Fig. 1) that this second step of erasure, 
just generates an amount of entropy that is the difference 
between the entropy of erasure of the first procedure and 
that of the first step of the second procedure. Therefore 
the entropy of erasure of Bob's systems which are in one 
of the states pi's is 



ASeriBob) =ASif -AS-W 

= S{p) ~^p,S{p^) 



(9) 



As the largest possible amount of information available 
to the receiver Bob is bounded by his entropy of erasure 
we have 



/ < ASeriBob) - S{p) - J2p^S{p,) = I„ 



(10) 



Therefore we have obtained the Holevo bound on the 
information in the states pi which appear with probabili- 
ties Pi . While this derivation only establishes the Holevo 
bound as an upper bound, one may argue that if Bob's 
quantum states contain less than Ih, then we would ex- 
pect to be able to find an even lower entropy of erasure 
for his message. Of course such an argument for the 
achievability of the Holevo bound cannot replace a full 
analytical proof, but merely forms the basis for a conjec- 
ture which is likely to be true. 



IV. CONCLUSIONS 

In this paper we have shown a different way of under- 
standing the origin of the Holevo bound on the classical 
information capacity of an encoding using mixed quan- 
tum states. While the resulting bound is of course not 
new in itself we hope that this approach to the Holevo 
bound may help to stimulate new insights into the more 
difficult and yet to be solved question of the quantum 
capacity of a quantum channel. 
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